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METHOD AND APPARATUS FOR DETERMINING REFERENCE 
PICTURE AND BLOCK MODE FOR FAST MOTION ESTIMATION 

[01] This application claims the priority of Korean Patent 

Application No. 2003-27540 filed on April 30, 2003 in the Korean Intellectual 
Property Office, the disclosure of which is incorporated herein in its entirety 
by reference. 

BACKGROUND OF THE INVENTION 

1 . Field of the Invention 

[02] The present invention relates to fast motion estimation for inter 

prediction coding, and more particularly, to a method and apparatus for 
determining a reference picture and a block mode for fast motion estimation. 

2. Description of the Related Art 

[03] A moving picture consists of a plurality of frames, and the 

plurality of frames are continuously displayed thus allowing a user to view the 
moving picture. According to the characteristics of an image signal, there is a 
similarity between adjacent frames, between adjacent blocks, or between 
pixels of the same frame. 

[04] It is possible to highly efficiently compress an image signal by 
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prediction coding the image signal based on the similarity in the image signal. 
Prediction coding is classified into inter prediction coding using the similarity 
between adjacent frames and intra prediction coding using the similarity in an 
image signal. 

[05] More specifically, inter prediction coding is performed by 

dividing image data contained in a current frame into predetermined units, e.g., 
units of 16x16 pixel macro blocks, searching for previous frames on a macro 
block basis, and accomplishing motion estimation. A previous frame used for 
motion estimation is referred to as a reference frame. 

[06] In motion estimation, a macro block, which is the most similar 

to a macro block in the current frame, is searched for in the previous frames 
using a measure function, and a motion vector representation of the difference 
between locations of the macro block in the current frame and the searched 
macro block is obtained. 

[07] Motion estimation can be realized using various methods. For 

instance, motion estimation is performed using a plurality of reference pictures 
according to the ITU-T H.26L video compression standard. Also, motion 
estimation is not limited to a macro block mode, that is, motion estimation can 
be performed in various sized block modes thus improving encoding 
efficiency. 

[08] FIG. 1 illustrates a current picture Pc* and N reference pictures 

Po through P N -i used for motion estimation of the current picture. For inter 
prediction encoding, motion estimation is performed on the current picture Pq 
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on a predetermined block basis using the N reference pictures Po through /V-/. 
[09] FIG. 2 illustrates various block modes in which motion 

estimation is performed. Referring to FIG. 2, (a) through (d) denote a 16x16 
block mode, a 16x8 block mode, an 8 X 16 block mode, and an 8x8 block mode, 
respectively. 

[10] As shown in FIG. 2 (e) through (h), motion estimation can be 

performed on an 8x8 block in an 8x8 block mode, an 8x4 block mode, a 4x8 
block mode, or a 4x4 block mode. 

[11] As apparent from FIG. 2, if the number of block modes is seven, 

there are nineteen block modes in which motion estimation can be performed 
on a 16x16 macro block. Further, when a plurality of reference pictures are 
offered, a number of block modes available on a macro block basis is very 
large. 

[12] Referring to FIG. 1, if a number of reference pictures is N, a 

number of block modes available for motion estimation using all the reference 
pictures is 9xN. 

[13] A motion vector is obtained by performing motion estimation 

on the respective reference pictures in all block modes available, and a 
reference picture and a block mode, which lead to the highest compression 
efficiency, are determined using the motion vector. Therefore, it is possible to 
increase bit rate efficiency and compress images so as to obtain higher 
definition of the images with a reduced bit rate. 

[14] However, when an image encoder performs motion estimation 
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on a plurality of reference pictures in various block modes, the amount of 
calculation is very large, thus remarkably increasing complexity. 
[15] Even if motion estimation is performed on only one reference 

picture, it is impossible to largely reduce the amount of calculation, i.e., the 
complexity, because motion estimation must be done in various block modes. 

SUMMARY OF THE INVENTION 
[16] The present invention provides a method and apparatus for 

determining a reference picture and a block mode with less calculation when 
performing motion estimation on a plurality of reference pictures in a plurality 
of block modes. 

[17] The present invention also provides a method and apparatus for 

determining a block mode with less calculation when performing motion 
estimation on a reference picture in a plurality of block modes. 
[18] According to an embodiment of the present invention, there is 

provided a method of determining a reference picture and a block mode, the 
method including a method of determining a reference picture and a block 
mode, the method comprising (a) dividing a video data block of a 
predetermined size into 2M first sub blocks, wherein M is an integer that 
equals or is larger than 1; (b) selecting reference pictures for motion 
estimation on the respective 2M first sub blocks from N reference pictures, 
wherein N is an integer that equals or is larger than 2; (c) counting a number 
of the first sub blocks that use the same reference picture; (d) determining 
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whether there are two adjacent first sub blocks using the same reference 
picture when a number of the first sub blocks using the same reference picture 
is two or more and is (2M-1) or less; and (e) when there are two adjacent first 
sub blocks using the same reference picture, determining a reference picture 
and a block mode depending on whether two motion vectors are similar, the 
two motion vectors obtained by performing motion estimation on the two 
respective adjacent first sub blocks. 

[19] According to another embodiment of the present invention, 

there is provided an apparatus for determining a reference picture and a block 
mode, the apparatus comprising a block divider that divides an input video 
data block of a predetermined size into 2M first sub blocks, wherein M is an 
integer that equals or is larger than 1; a motion estimator that receives N 
reference pictures, receives the 2M first sub blocks from the block divider, and 
performs motion estimation on the respective first sub blocks using the N 
reference pictures, wherein N is an integer that equals or is larger than 2; and a 
reference picture/block mode determination unit that determines a reference 
picture, which is used when obtaining the highest accuracy of the result of 
motion estimation received from the motion estimator, as a reference picture 
for the first sub blocks using the N reference pictures, and N reference values 
that indicate accuracy of the result of motion estimation performed on the 
respective first sub blocks N times, and receives, from the motion estimator, 
two motion vectors obtained by performing motion estimation on two adjacent 
first sub blocks using the same reference picture and determines a reference 



5 



picture and a block mode depending on whether the two motion vectors are 
similar, when a number of the first sub blocks using the same reference picture 
is two or more and (2M-1) or less and two adjacent first sub blocks using the 
same reference picture are present. 

[20] According to yet another embodiment of the present invention, 

there is provided a method of determining a block mode, the method including 

(a) performing motion estimation on an input video data block in a mode of 
first sub blocks thereof using a predetermined reference picture and a 
predetermined measure function for motion estimation, and obtaining values 
of the measure function and motion vectors for the respective first sub blocks; 

(b) determining whether there is a need to perform motion estimation on the 
video data block in a mode of second sub blocks thereof which are smaller 
than the mode of the first sub blocks; and (c) when there is no need to perform 
motion estimation on the video data block in the mode of the second sub 
blocks, determining a block mode of the video data block depending on 
whether motion vectors of the first sub blocks are similar. 

[21] According to still another embodiment of the present invention, 

there is provided an apparatus for determining a reference picture and a block 
mode, the apparatus comprising a block divider that divides a video data block 
into a plurality of first sub blocks; a motion estimator that determines values 
of measure function and motion vectors of the respective first sub blocks by 
receiving N predetermined reference pictures, receiving the plurality of first 
sub blocks from the block divider, and performing motion estimation on the 
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video data block in a mode of the first sub blocks using the N reference 
pictures and a predetermined measure function for motion estimation; and a 
block mode determination unit that determines a block mode depending on 
whether motion vectors of the respective first sub blocks are similar, when it is 
determined that there is no need to perform motion estimation on the video 
data block in a mode of second sub blocks that is smaller than the mode of the 
first sub blocks, using a plurality of values of measure function calculated by 
performing motion estimation on the first sub blocks received from the motion 
estimator. 

BRIEF DESCRIPTION OF THE DRAWINGS 

[22] The above and other aspects and advantages of the present 

invention will become more apparent by describing in detail exemplary 

embodiments thereof with reference to the attached drawings in which: 

[23] FIG. 1 illustrates a current picture and a plurality of reference 

pictures used for motion estimation of the current picture; 

[24] FIG. 2 illustrates various block modes for motion estimation; 

[25] FIG. 3 is a block diagram of a moving picture encoding 

apparatus according to an embodiment of the present invention; 

[26] FIG. 4 is a block diagram of an apparatus for determining a 

reference picture and a block mode according to an embodiment of the present 

invention; 

[27] FIG. 5 illustrates an example of dividing an input macro block 

into four 8x8 sub blocks; 
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[28] FIG. 6A is a flowchart illustrating a method of determining a 

reference picture and a block mode according to an embodiment of the present 
invention; 

[29] FIG. 6B is a flowchart illustrating a method of determining a 

reference picture and a block mode for motion estimation when the number of 
sub blocks using the same reference picture is two, according to an 
embodiment of the present invention; 

[30] FIGs. 6C and 6D illustrate flowcharts illustrating a method of 

determining a reference picture and a block mode for motion estimation when 
the number of sub blocks using the same reference picture is three, according 
to an embodiment of the present invention; 

[31] FIG. 7 is a detailed flowchart illustrating step 212 of FIG. 6 A; 

[32] FIG. 8 is a block diagram of an apparatus for determining a 

block mode according to an embodiment of the present invention; 

[33] FIG. 9 is a flowchart illustrating a method of determining a 

block mode according to an embodiment of the present invention; 

[34] FIG. 10 illustrates values of a sum-of-absolute-difference 

(SAD) function, which are stored in 4><4 block unit; 

[35] FIG. 1 1 is a detailed flowchart illustrating step 500 of FIG. 9; 

[36] FIG. 12 is a detailed flowchart illustrating step 600 of FIG. 9; 

[37] FIG. 13 is a detailed flowchart illustrating step 800 of FIG. 9; 

and 

[38] FIG. 14 is a detailed flowchart illustrating step 900 of FIG. 9. 
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DETAILED DESCRIPTION OF THE ILLUSTRATIVE, NON- 
LIMITING EMBODIMENTS OF THE INVENTION 

[39] Hereinafter, illustrative, non-limiting embodiments of the 

present invention will be described in detail with reference to the 

accompanying drawings. 

[40] FIG. 3 is a block diagram of a moving picture encoding 

apparatus according to an embodiment of the present invention. Referring to 
FIG. 3, the moving picture encoding apparatus includes a 
transformer/quantizer 1 1 0, a dequantizer/inverse transform 1 3 1 , a deblocking 
filter 133 5 a picture reproduction unit 135, a motion compensated predictor 
137, an intra predictor 139, a motion estimator 150, a subtracter 170, and an 
entropy coding unit 190. 

[41] Image data is input to the moving picture encoding apparatus of 

FIG. 3 in units of 16x16 pixel macro blocks. 

[42] The transformer/quantizer 1 1 0 transforms input macro blocks 

in a predetermined manner and quantizes the result of transformation. A 
discrete cosine transform (DCT) is commonly used as the image conversion 
technique. 

[43] The dequantizer/inverse transformer 131 receives DCTed and 

quantized image data from the transformer/quantizer 110, inversely quantizes 
the image data, and performs inverse DCT on the inversely quantized image 
data. 

[44] The deblocking filter 133 receives the inversely quantized DCT 
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image data from the dequantizer/inverse transformer 131 and filters it to 
remove blocking effect therefrom. 

[45] The picture reproduction unit 135 receives the filtered image 

data from the deblocking filter 133 and reproduces and stores it in picture 
units. Here, a picture denotes an image in units of frames or fields. The 
picture reproduction unit 135 includes a buffer (not shown) capable of storing 
a plurality of pictures. The plurality of pictures stored in the buffer are 
provided for motion estimation and will be referred to as reference pictures in 
this disclosure. 

[46] The motion estimator 150 is provided with at least one 

reference picture from the picture reproduction unit 135, performs motion 
estimation on the reference picture on an input macro block basis, and outputs 
motion data that includes a motion vector, an index indicating the reference 
picture, and a block mode. 

[47] The motion compensated predictor 137 receives the motion 

data from the motion estimator 150 and extracts and outputs a macro block 
corresponding to the input macro block using a reference picture, which is 
used for motion estimation, selected from the plurality of reference pictures 
stored in the picture reproduction unit 135, based on the motion data. 
[48] For inter prediction coding of the input macro block, the 

subtracter 170 receives a macro block of the reference picture corresponding 
to the input macro block from the motion compensated predictor 137, 
performs a subtraction operation between the received macro block and the 
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input macro block, and outputs the result of subtraction as a residue signal. 
[49] The residue signal output from the subtracter 170 is 

transformed and quantized by the transformer/quantizer 110, and entropy- 
encoded by the entropy coding unit 190, and generated as an output bit stream. 
[50] The intra predictor 139 performs intra prediction coding, other 

than inter prediction coding, using the reference picture. 

[51] A moving picture decoding unit 133, which decodes the bit 

stream generated by the moving picture encoding apparatus, includes the 
dequantizer/inverse transformer 131, the deblocking filter 133, the picture 
reproduction unit 135, the motion compensated predictor 137, and the intra 
prediction unit 139. 

[52] Hereinafter, determination of a reference picture and a block 

mode when performing motion estimation on a plurality of reference pictures 
in a plurality of block modes, according to the present invention, will be 
described. 

[53] FIG. 4 is a block diagram of an apparatus for determining a 

reference picture and a block mode according to an embodiment of the present 
invention. The apparatus of FIG. 4 includes a block divider 151, a motion 
estimator 153, and a reference picture/block mode determination unit 154. 
[54] The apparatus of FIG. 4 may be equivalent to the motion 

estimator 1 50 included in the moving picture encoding apparatus of FIG. 3 or 
be included in the motion estimator 150, and perform a method of determining 
a reference picture and a block mode according to the present invention. 
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[55] The block divider 151 receives input block data, i.e., image 

data in macro block units, divides the macro block into predetermined sized 
sub blocks, and outputs the image data in the sub block units. 
[56] FIG. 5 illustrates an example of an input macro block that is 

divided into four 8*8 sub blocks Bi, B2, B^ and B 4 using the block divider 151. 
[57] The motion estimator 153 of FIG. 4 receives N reference 

pictures as shown in FIG. 1 and 8x8 sub blocks from the block divider 151, 
and performs motion estimation using them. 

[58] The reference picture/block mode determination unit 154 

receives data, for determining a reference picture and a block mode, from the 
motion estimator 153, determines a reference picture and a block mode, and 
outputs motion data including an index of a reference picture used for motion 
estimation, a block mode, and a motion vector. 

[59] A method, according to the present invention, which 

determines a reference picture and a block mode according to the present 
invention using an apparatus according to the present invention, will now be 
described. 

[60] FIGs. 6A through 6D are flowcharts illustrating a method of 

determining a reference picture and a block mode, according to embodiments 
of the present invention. 

[61] Referring to FIG. 6 A, the block divider 151 divides an input 

macro block into four 8x8 sub blocks 5/, B 2 , B3, and B 4 as shown in FIG. 5 
(step 210). 
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[62] Next, the motion estimator 153 sequentially receives four 8x8 

sub blocks 5/, B2, £3, and B 4 from the block divider 151 and determines four 
pictures for motion estimation of the respective four sub blocks /?/, B2, B3, and 
B4, using N reference pictures such as that shown in FIG. 1 (step 212). 
[63] FIG. 7 is a detailed flowchart illustrating step 212 of FIG. 6A. 

The motion estimator 153 reads one of the N reference pictures from the 
picture reproducing unit 135 and performs motion estimation on the respective 
8x8 sub blocks B h B 2 , B 3 , and B 4 N times (step 212a). 

[64] In general, motion estimation is performed using a measure 

function, such as a sum-of-absolute-difference (SAD) function, for 
predetermined motion estimation. A value of the SAD function is obtained by 
combining the absolute values of differences between the values of pixels of 
an 8x8 block input from the block divider 151, and the values of pixels of an 
8x8 block at a point of a reference picture, at the same points. 
[65] SAD function values are measured with respect to all 8x8 

blocks available in the reference picture, and an 8x8 block having a minimum 
SAD function value is detected. A motion vector shows a variation in location 
of an 8x8 block of a current picture with respect to that of the 8x8 block of the 
reference picture. 

[66] Alternatively, a measure function, other than the SAD function, 

may be used for motion estimation. For instance, a sum-of-absolute- 
transformed-difference (SATD) function or a sum-of-squared-difference 
(SSD) function may be used. 
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[67] After step 212a, the reference picture/block mode 

determination unit 154 determines ones of the N reference pictures, which 
results in the highest accuracy of motion estimation, as reference pictures for 
the sub blocks B h B 2 , B 3 and B 4 (step 212b). 

[68] The accuracy of motion estimation is determined by sizes of the 

SAD function values calculated using the respective reference pictures, based 
on a fact that the higher the similarity between the current picture and the 
reference picture, the smaller the SAD function value. 

[69] In steps 210 and 212, reference pictures, which will be used for 

motion estimation on the respective 8x8 blocks, are determined by performing 
motion estimation in the 8x8 block mode. 

[70] The reference picture/block mode determination unit 154 

counts equivalent reference pictures, among the four reference pictures, which 
are determined with respect to the respective four blocks Bj, B 2 , B 3 , and B 4 in 
step 212 (step 214). 

[71] If it is determined in step 214 that the equivalent reference 

pictures total four, that is, when all the four sub blocks Bu B 2 , B 3 , and B 4 use 
the equivalent four reference pictures, the reference pictures are finally 
determined as the reference pictures for motion estimation of the four blocks 
(step 215). 

[72] Upon determining the final reference pictures for the four sub 

blocks B/, B 2 , B 3 , and B 4 , block modes for the four sub blocks Bu B 2 , B 3 , and 
B 4 are determined (step 216). One of 8x8, 8x4, 4x8, and 4x4 block modes is 
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determined as a block mode of each of the four sub blocks B2, 5j 5 and B4, 
using various methods. For instance, motion estimation is performed on the 
respective sub blocks Bu B2, B3, and B 4 in various sub block modes that are 
smaller than or equivalent to the 8x8 block mode, and then, one of the sub 
block modes, in which the highest encoding performance for motion 
estimation is obtained, is selected as the block mode. 

[73] If it is determined in step 214 that the number of equivalent 

reference pictures is one, that is, when all the four sub blocks 5/, 2?^, and 
B 4 use different reference pictures, the reference pictures determined in step 
212 are finally determined as the reference pictures used for motion estimation 
of the four blocks (step 218). 

[74] After step 218, a block mode of each of the four sub blocks B/, 

B2, B3, and B4 is determined similarly to step 216 (step 219). A method of 
determining a block mode of the four sub blocks B/, B 2 , B3, and B 4 is not 
limited. 

[75] FIG. 6B is a flowchart illustrating a method of determining a 

reference picture and a block mode when there are two equivalent reference 
pictures. 

[76] If it is determined in step 214 that a number of sub blocks using 

the same reference picture is two, for example, when reference pictures used 
by the sub blocks B/ and B 2 are the same (step 220), the reference 
picture/block mode determination unit 1 54 determines whether motion vectors 
MV(B}) and MV(B2) of the respective sub blocks B/ and B 2 received from the 
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motion estimator 153 are similar to each other (step 222). The motion vectors 
MV(Bj) and MV(B2) are obtained using the reference pictures of the sub blocks 
Bj and B2 determined in step 212. 

[77] When the two 8x8 sub blocks Bi and B2 use the same reference 

picture and their motion vectors are similar to each other, the same motion 
vectors are expected to be obtained even when motion estimation is performed 
on a 16x8 block, which is obtained by grouping the sub blocks B/ and B2, 
using the same reference picture. Accordingly, an input macro block is 
determined to be a 16x8 block mode and motion estimation is performed in 
the 16x8 block mode. 

[78] In this embodiment, it is assumed that the sub blocks Bj and B 2 

use the same reference picture. However, motion estimation is performed in 
an 8x16 block mode, when the sub blocks B t and B 3 , or the sub blocks 5 2 and 
B 4 use equivalent reference pictures and the motion vectors MV(Bj) and 
MV(Bz) or the motion vectors MV(B2) and MV(B4) are similar to each other. 
[79] Whether two motion vectors are equivalent to each other may 

be determined using the difference between coordinate values of X-axes of the 
two motion vectors and the difference between coordinate values of Y-axes 
thereof. That is, when the differences fall within predetermined limit values, 
the two motion vectors are determined to be equivalent to each other. 
[80] If the motion vectors MV(Bj) and MV(B^) are different from 

each other, a block mode of the input macro block is determined as an 8x8 
block mode (step 242). In this case, the reference pictures determined in step 
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212 are finally determined as those for the sub blocks B2, B 3 , and B 4 . 
[81] However, when the motion vectors MV(Bi) and MV(B2) are 

equivalent to each other, the block divider 151 groups the sub blocks B/ and 
B2, and the sub blocks B3 and B 4 into two respective 16><8 sub blocks B21 and 

B22 and provides the 16x8 sub blocks B 2 / and B22 to the motion estimator 153, 

1 

in response to a control signal generated by the reference picture/block mode 
determination unit 1 54 (step 224). 

[82] After step 224, the reference picture/block mode determination 

unit 1 54 determines a reference picture RefPic(B2i) used for motion estimation 
for the sub block B21, i.e., a combination of the sub blocks Bj and B2, to be a 
reference picture used by the sub blocks Bj and B2 (step 226). 
[83] Also, motion estimation is performed on the sub block B22 

using reference pictures RefPic(B 3 ) and RefPic(B 4 ) for the respective sub 
blocks B 3 and B 4 so as to determine a reference picture for the sub block B22 
(step 228). 

[84] After step 228, it is determined whether use of the reference 

picture RefPic(B 3 ) or reference picture RefPic(B 4 ) results in more precise 
motion estimation (step 230). Similarly to step 212b, SAD function values are 
used for the determination in step 228. 

[85] After step 230, a reference picture RefPic(B 2 2) for the sub block 

B22 is determined to be equivalent to the reference picture RefPic(B 3 ) or 
RefPic(B 4 ) (step 232 or 234). 

[86] Next, the amount of data obtained by performing motion 
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estimation in the 8x8 block mode in steps 210 and 212, and the amount of data 
obtained by performing motion estimation in the 16><8 block mode in steps 
224 through 234 are calculated (step 236). 

[87] Next, the amounts of data are compared to each other (step 

238). In the case that the amount of data obtained by motion estimation in the 
16x8 block mode is less than that of data obtained by motion estimation in the 
8x8 block mode, it can be understood that encoding efficiency in the 16x8 
block mode is better than that in the 8x8 block mode, and therefore, the 16x8 
block mode is finally selected (step 240). 

[88] However, when the amount of data obtained by motion 

estimation in the 16x8 block mode is more than that of data obtained by 
motion estimation in the 8x8 block mode, the 8x8 block mode is finally 
selected (step 242). 

[89] In this embodiment, the encoding efficiency is determined 

based on the amount of data obtained by performing motion estimation in 
respective block modes. For instance, the amount of data may be measured 
using one of the aforementioned SAD function, a SATD function, a SSD 
function, a mean-of-absolute-difference (MAD) function, or a Lagrange 
function. 

[90] Alternatively, the encoding efficiency may be determined based 

on a predetermined determination method in consideration of both the amount 
of data and image quality. That is, a method of determining the encoding 
efficiency is not limited to the above description, and further, those skilled in 
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the art could have determined the encoding efficiency using various methods. 
[91] Meanwhile, this embodiment discloses that the sub blocks B/ 

and B2 use the same reference picture, but the method of FIGs. 6A and 6B can 
be applied when the sub blocks Bj and B3 or the sub blocks B2 and B 4 use the 
same reference picture. 

[92] Although now shown in the drawings, when two adjacent 

blocks, e.g., the sub blocks Bi and B 3> use the same reference picture and two 
adjacent blocks, e.g., the sub blocks B2 and B 4 , use different reference pictures, 
it is possible to skip steps 228 through 234. 

[93] Even if two sub blocks, e.g., the sub blocks B/ and B 4 , use the 

same reference picture, the 8x8 block mode is determined as a block mode for 
motion estimation on an input macro block without taking any steps when the 
two sub blocks Bj and B 4 are not adjacent to each other. 

[94] FIGs. 6C and 6D are flowcharts illustrating a method of 

determining a reference picture and a block mode when a number of 
equivalent reference pictures is three, according to an embodiment of the 
present invention. 

[95] The methods of FIGs. 6C and 6D are basically almost the same 

as that of FIG. 6B performed when a number of equivalent reference pictures 
is two. That is, depending on whether the adjacent two blocks are similar to 
each other, adjacent two blocks are combined together to make a new block 
mode; motion estimation is performed in the new block mode; the result of 
motion estimation is compared with that of the motion estimation which has 
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already been performed in the 8*8 block mode, and one of the new block 
mode and the 8><8 block mode, which leads to higher encoding efficiency, is 
determined as a final block mode. 

[96] Hereinafter, a method of determining a reference picture and a 

block mode with respect to three equivalent reference pictures will be 
described in detail. 

[97] If it is determined in step 214 that three equivalent reference 

pictures are present, e.g., when equivalent reference pictures are determined to 
be used by the sub blocks Bj, B 2 , and Bs (step 250), the reference picture/block 
mode determination unit 154 determines whether the motion vectors MV(Bj) 
and MV(B 2 ) of the sub blocks Bj and B 2 , which are received from the motion 
estimator 153, are similar to each other (step 252). Here, the motion vectors 
MV(Bi) and MV(B 2 ) are obtained using the reference pictures, for the 
respective sub blocks Bj and B 2 , which are determined in step 212. 
[98] Whether the motion vectors MV(Bj) and MV(B 2 ) are similar to 

each other may be determined using the difference between coordinate values 
of X-axes of the motion vectors MV(Bj) and MV(B 2 ) and the difference 
between coordinate values of Y-axes thereof. That is, when these differences 
fall within predetermined limit values, the two motion vectors are determined 
to be equivalent to each other. 

[99] If the motion vectors MV(Bi) and MV(B 2 ) are similar to each 

other, the block divider 151 groups the sub blocks Bj and B 2 and the sub 
blocks Bs and B4 into two respective 16><8 sub blocks B 2 j and B 22 and provides 
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the sub blocks B21 and B22 to the motion estimator 153, in response to a control 
signal generated by the reference picture/block mode determination unit 154 
(step 254). 

[100] The reference picture/block mode determination unit 154 

determines the reference picture RefPic(B2j) for motion estimation on the sub 
block B 2 h i.e., a combination of the sub blocks Bj and B2, as the same 
reference picture used by the sub blocks Bj and B 2 (step 256). 
[101] Next, motion estimation is performed on the sub block B22 to 

determine a reference picture for the sub block B22 using reference pictures 
RefPic(B 3 ) and RefPic(B 4 ) of the respective sub blocks B 3 and B4 (step 258). 
[102] After step 258, it is determined whether use of the reference 

picture RefPic(B 3 ) or the reference picture RefPic(B 4 ) results in more precise 
motion estimation (step 260). Similarly to step 212b, SAD function values are 
used for the determination in step 260. 

[103] According to the result of determination in step 260, the 

reference picture RefPic(B 2 2) is determined to be equivalent to the reference 
picture RefPic(B 3 ) or the Reference picture RefPic(B 4 ) (step 262 or 264). 
[104] Next, the amount of data obtained by performing motion 

estimation in the 8x8 block mode in steps 210 and 212 and that of data 
obtained by performing motion estimation in the 16x8 block mode in steps 
254 through 264 are calculated (step 266). 

[105] Next, the amount of data obtained in steps 254 through 264 is 

compared with that of data obtained in steps 210 and 212 (step 268). If the 
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amount of data obtained by motion estimation in the 16><8 block mode is less 
than that of data obtained by motion estimation in the 8x8 block mode, it is 
understood that encoding efficiency in the 16x8 block mode is better than that 
in the 8x8 block mode, and thus, the 16x8 block mode is determined as a final 
block mode (step 270). 

[106] On the contrary, if the amount of data obtained in the 16x8 

block mode is more than that of data obtained in the 8x8 block mode, the 8x8 
block mode is determined as a final block mode (step 272). 
[107] In this embodiment, the encoding efficiency is determined 

based on the amounts of data obtained in the respective block modes. The 
amount of data obtained may be measured using one of the aforementioned 
SAD function, the SATD function, the SSD function, the MAD function, or 
the Lagrange function. 

[108] If it is determined in step 252 that the motion vectors MV(Bj) 

and MV(B2) are different from each other, steps shown in FIG. 6D are 
performed. The steps of FIG. 6D is almost the same as those of FIG. 6C 
except that the sub blocks Bj and #3, and the sub blocks B 2 and B 4 are grouped 
into two groups depending on whether the motion vectors MV(Bj) and MV(B 3 ) 
are equivalent to each other. 

[109] In other words, the reference picture/block mode determination 

unit 154 determines whether the motion vectors MV(Bi) and MV(B 3 ) for the 
sub blocks Bj and B3 received from the motion estimator 153 are equivalent to 
each other (step 280). 
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[110] If the motion vectors MV(Bi) and MV(B$) are similar to each 

other, the block divider 151 groups the sub blocks Bj and B 3 and the sub 
blocks B2 and B 4 into two 8><16 sub blocks B31 and B32' That is, the block 
divider 151 divides an input macro block into two 8><16 sub blocks B31 and B32 
and provides them to the motion estimator 153, in response to a control signal 
generated by the reference picture/block mode determination unit 154 (step 
282). 

[Ill] After step 282, the reference picture/block mode determination 

unit 154 determines a reference picture RefPic(B 3I ) for motion estimation on 
the sub block #37, which is obtained by grouping the sub blocks Bj and #3, as a 
reference picture used by the sub blocks B\ and B3 (step 284). 
[112] Next, motion estimation is performed on the sub block B32 to 

determine a reference picture therefor using the reference pictures RefPic(B2) 
and RefPic(B 4 ) for the sub blocks B 2 and B 4 (step 286). 

[113] After step 286, it is determined whether use of the reference 

picture RefPic(B 2 ) or the reference picture RefPic(B 4 ) leads to more precise 
motion estimation (step 288). 

[114] Based on the result of step 288, the reference picture 

RefPic(B 32 ) is determined to be equivalent to the reference picture RefPic(B 2 ) 
or the reference picture RefP\c(B 4 ) (step 290 or 292). 

[115] Next, the amount of data obtained by performing motion 

estimation in the 8x8 block mode in steps 210 and 212, and that of data 
obtained by performing motion estimation in the 8x16 block mode in steps 
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282 through 292 are calculated (step 294). 

[116] Next, the amount of data obtained in steps 210 and 212 is 

compared with that of data obtained in steps 282 through 292 (step 296). If 
the amount of data obtained in the 8x16 block mode is less than that of data 
obtained in the 8><8 block mode, it is understood that encoding efficiency in 
the 8x16 block mode is better than that in the 8x8 block mode, and thus, the 
8x16 block mode is determined to be a final block mode (step 298). 
[117] On the contrary, when the amount of data obtained in the 8x16 

block mode is more than that of data obtained in the 8x8 block mode, the 8x8 
block mode is determined as a final block mode (step 299). 
[118] Also, in this embodiment, the sub blocks 2?;, B 2 , and B3 use the 

same reference picture, but a reference picture and a block mode can also be 
determined using the same methods of FIGs. 6C and 6D when the sub blocks 
2?/, B 2 , and B 4 , or the sub block B 2 , B 3 , and B 4 use the same reference picture. 
[119] However, in steps 252 through 280, determination of the 

similarity between motion vectors of two sub blocks is applied to only 
adjacent two sub blocks. For instance, even if two sub blocks adjacent in the 
diagonal direction use the same reference picture, the similarity between their 
motion vectors is not determined. 

[120] Hereinafter, when a plurality of sub blocks use reference 

pictures and motion estimation is performed in a plurality of block modes, a 
method of determining a block mode, according to an embodiment of the 
present invention will be described. 
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[121] FIG. 8 is a block diagram of an apparatus for determining a 

block mode, according to an embodiment of the present invention. The 
apparatus of FIG. 8 includes a block divider 155, a motion estimator 157, and 
a block mode determination unit 159. 

[122] The apparatus of FIG. 8 may be equal to the motion estimator 

150 of FIG. 3 or be included in the motion estimator 150, and performs a 
method of determining a block mode according to the present invention. In 
particular, the apparatus of FIG. 8 performs a method of determining a block 
mode according to the present invention when only a reference picture or only 
one of a plurality of reference pictures provided is used for motion estimation. 
[123] The block divider 155 receives an input video data block, i.e., 

image data in macro block units, divides the macro block into predetermined 
numbers of sub blocks, e.g., the 8><8 sub blocks i?/, B2, B3, and B 4 shown in 
FIG. 5, and outputs the image data in sub block units. 

[124] The motion estimator 157 receives a reference picture, receives 

the 8><8 sub blocks from the block divider 155, and performs motion 
estimation on the 8x8 sub blocks using the reference picture. 
[125] The block mode determination unit 159 receives, from the 

motion estimator 157, data used to determine a block mode, performs a 
method of determining a block mode according to the present invention, and 
outputs motion data including the block mode and motion vectors for motion 
estimation. 

[126] A method of determining a block mode, according to the 
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present invention, using an apparatus such as that shown in FIG. 8 will be 
described. 

[127] FIG. 9 is a flowchart illustrating a method of determining a 

block mode, according to an embodiment of the present invention. 
[128] Referring to FIG. 9, the block divider 155 divides an input 

macro block into four 8x8 sub blocks 2?/, B 2 , B3, and B 4 as shown in FIG. 5 
(step 410). 

[129] Next, the motion estimator 157 sequentially receives the four 

8><8 sub blocks Bu B 2 , B3, and B4 from the block divider 155, determines their 
motion vectors by performing motion estimation on the respective 8x8 sub 
blocks using the input reference pictures, and stores costs in 4x4 block units 
(step 412). In this embodiment, motion estimation is performed using the 
aforementioned SAD function. 

[130] More specifically, SAD function values are calculated with 

respect to the respective sub blocks B h B 2 , B 3 , and B 4 with respect to every 
possible 8x8 sub blocks divided from the reference block. Next, an 8x8 sub 
block, of the reference picture, which has the minimum SAD function value is 
detected, and then, motion vectors MV(Bj), MV(B 2 ), MV(B 3 ), and MV(B 4 ) for 
B/, B3, and B4 with respect to the detected 8x8 sub block are determined. 
The SAD function values are stored in 4x4 block units so that they can be 
used during a subsequent process. The SAD function values stored in the 4x4 
block units are referred to as costs. 

[131] FIG. 10 illustrates SAD function values that are calculated to 
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determine motion vectors for respective sub blocks Bj, B 2 , B3, and B 4 and 
stored in 4x4 block units. 

[132] For instance, in the case of the sub block SAD function 

values are calculated in 4x4 sub block units, stored as Cyy, C/2 3 C/3, and C14, 
and combined to obtain a SAD function value. That is, the SAD function 
value of the sub block Bj is a sum of the values C//, C/2, C/j, and C14. 
[133] Alternatively, a function, other than the SAD function, may be 

used as a measure function for motion estimation. For instance, the SATD 
function or the SSD function may be used. 

[134] In above steps 410 and 412, motion estimation is first 

performed in the 8x8 block mode among a plurality of block modes. After 
step 412, a final block mode is determined based on result of motion 
estimation performed in the 8x8 block mode. 

[135] Next, the block mode determination unit 159 determines the 

similarity among SAD function values, of the respective four sub blocks Bj, B 2 , 
B3, and B 4 , which are stored in the 4x4 block units (step 414). 
[136] In step 412, it is determined whether there is a need to perform 

motion estimation on a basis of blocks that are smaller than the 8x8 blocks. 
For the determination, SAD function values, which are referred to as cost, 
stored during motion estimation in step 412, are used. For instance, when one 
of the four SAD function values C/y, C /2 , C/3, and Cj 4 of the sub block Bj is 
fairly smaller than the other three SAD function values, the result of motion 
estimation performed in the 8x8 block mode is considered as incorrect. 
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Therefore, motion estimation is performed in a block mode, which is smaller 
than the 8x8 block mode, so as to obtain more precise motion estimation. 
[137] The similarity between two SAD function values may be 

determined, for example, by checking whether the difference between the two 
SAD function values falls within a predetermined limit value. 
[138] If it is determined in step 414 that the SAD function values Cyy, 

Cj2, Cj3, and C I4 of the sub block B/ are similar, SAD function values Qy, C22, 
C23, and C24 of the sub block B2 are similar, SAD function values Cjy, C32, C33, 
and C34 of the sub block B3 are similar, and SAD function values C/y, CV?> C43, 
and C44 of the sub block B4 are also similar, then in this case, a block mode is 
determined depending on whether the motion vectors MV(Bi), MV(B2), 
MV(B3), and MV(B 4 ), of the sub blocks 2?y, B 2 , B3, and B4, determined in step 
412, are similar (step 500). 

[139] If it is determined in step 414 that there is no need to perform 

motion estimation in a block mode which is smaller than the 8x8 block mode, 
whether a block mode, which is larger than the 8x8 block mode, can be set as 
a final block mode is determined based on the similarity among the motion 
vectors MV(B0, MV(B 2 ), MV(B 3 ), and MV(B 4 ) in step 500. 
[140] FIG. 11 is a detailed flowchart illustrating step 500 of FIG. 9. 

Referring to FIG. 11, the similarity among the four motion vectors MV(Bi), 
MV(B 2 ), MV(B 3 ), and MV(B 4 ) is determined (steps 510 through 514, 520, 526, 
and 530). If all the motion vectors MV(B1) through MV(B4) are similar, the 
16x16 block mode is determined as a final block mode (step 516). 
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[141] If the motion vectors MV(B1) and MV(B2) are similar and the 

motion vectors MV(B3) and MV(B4) are similar, a 16x8 block mode is chosen 
as a final block mode (step 522). If the motion vectors MV(BJ) and MV(B3) 
are similar and the motion vectors MV(B2) and MV(B4) are similar, an 8x16 
block mode is chosen as a final block mode (step 532). 

[142] However, there are cases where no pairs of adjacent blocks 

having similar motion vectors are present, or motion vectors of a pair of 
adjacent first sub blocks are similar but motion vectors of another pair of 
adjacent to first sub blocks are not similar. In this case, the 8x8 block mode is 
chosen as a final block mode (steps 518, 524, 528, and 534). 
[143] In FIG. 11, "=" denotes that two motion vectors are similar 

rather than are the same. 

[144] Next, the amount of data obtained in a block mode determined 

in step 500 is compared with that of data obtained in the 8x8 block mode in 
steps 410 and 412, and the block mode where less amount of data is obtained 
is determined a final block mode (step 600). 

[145] FIG. 12 is a detailed flowchart illustrating step 600 of FIG. 9. 

Referring to FIG. 9, the type of block mode determined in step 500 is checked 
(step 610). 

[146] If the determined block mode is the 16x16 block mode, a cost 

cost (8*8) in the 8x8 block mode is calculated (step 612). Here, the cost cost 
(8x8) denotes a sum of the SAD function values computed in step 412 where 
the motion vectors for the sub blocks 2?/, B2, B 3 , and B 4 are obtained. The sum 
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of the SAD function values is used as a reference value allowing estimation of 
the amount of data to be encoded or transmitted when motion estimation is 
performed on a predetermined block basis. 

[147] The block mode determination unit 159 outputs a control signal 

to the block divider 155. Then, the block divider 155 receives the control 
signal and provides the input macro block to the motion estimator 157 without 
dividing the macro block into sub blocks. The motion estimator 157 performs 
motion estimation on the input macro block on a 16x16 block basis using a 
predetermined reference picture (step 614). 

[148] Next, during the motion estimation in step 614, the motion 

estimator 157 computes cost cost(16*16) (step 616). 

[149] * Next, the block mode determination unit 159 receives the costs 
cost(8*8) and cost(16*16) from the motion estimator 157 and compares them 
(step 618). 

[150] If it is determined in step 630 that the cost cost(16*16) is 

smaller than the cost cost(8><8), a block mode for motion estimation on the 
input macro block is finally determined as the 16x16 block mode (step 620). 
[151] In contrast, if it is determined in step 630 that the cost 

cost(8*8) is smaller than the cost cost(16*16), a block mode for motion 
estimation on the input macro block is finally determined as the 8x8 block 
mode (step 622). 

[152] When it is determined in step 610 that the type of block mode 

chosen in step 500 is the 8x8 block mode, the block mode for motion 
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estimation on the input macro block is determined as the 8x8 block mode 
without taking further steps (step 622). 

[153] When it is determined in step 610 that the type of block mode 

chosen in step 500 is the 8x16 block mode, a cost cost(8*8) in the 8x8 block 
mode is computed (step 624). 

[154] After step 624, the block mode determination unit 159 outputs 

the control signal to the block divider 155, and then, the block divider 155 
divides the input macro block into two 8x16 sub blocks and provides them to 
the motion estimator 157 in response to the control signal. Next, the motion 
estimator 157 performs motion estimation on the received two 8x16 sub 
blocks on an 8x16 block basis using a predetermined reference picture (step 
626). 

[155] After step 626, the motion estimator 157 computes a cost 

cost(8xl6) (step 628). Here, the cost cost(8*16) for the input macro block is 
obtained by combining respective costs cost (8*1 6) calculated during the 
motion estimation on the two 8x16 sub blocks. 

[156] Next, the block mode determination unit 159 receives the costs 

cost(8*8) and cost(8*16) from the motion estimator 157 and compares them 
(step 630). 

[157] If the cost cost(8*16) is smaller than the cost cost(8*8), a 

block mode for motion estimation on the input macro block is finally 
determined as the 8x16 block mode (step 632). 

[158] If the cost cost(8*8) is smaller than the cost cost(8*16), a 
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block mode for motion estimation on the input macro block is finally 
determined as the 8x8 block mode (step 622). 

[159] When it is determined in step 610 that the type of block mode 

chosen in step 500 is the 16x8 block mode, a cost cost(8><8) in the 8x8 block 
mode is computed (step 634). 

[160] Next, the block mode determination unit 159 outputs the 

control signal to the block divider 155, and the block divider 155 divides the 
input macro block into two 16x8 sub blocks and provides them to the motion 
estimator 157 in response to the control signal. Then, the motion estimator 
157 performs motion estimation on the received two 16x8 blocks on a 16x8 
block basis using a predetermined reference picture (step 636). 
[161] Next, the motion estimator 157 computes a cost cost(16*8) 

(step 638). Here, the cost cost(16*8) for the input macro block is obtained by 
combining the respective costs cost(16*8) calculated during motion 
estimation on the two 16x8 sub blocks. 

[162] Next, the block mode determination unit 159 receives the costs 

cost(8><8) and cost(16*8) from the motion estimator 157 and compares them 
(step 640). 

[163] If it is determined in step 640 that the cost cost(16*8) is 

smaller than the cost cost(8*8), a block mode for motion estimation on the 
input macro block is finally determined as the 16x8 block mode (step 642). 
[164] If the cost cost(8*8) is smaller than the cost cost(16*8), a 

block mode for motion estimation on the input macro block is finally 
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determined as the 8><8 block mode (step 622). 

[165] Meanwhile, in this embodiment, a final block mode is 

determined depending on the amount of data using the SAD function value as 
a cost. However, the amount of data is just a criterion for determining 
encoding efficiency of motion estimation in the respective block modes. For 
the determination of the encoding efficiency, various criteria, for example, 
image quality, may further be used. In other words, various methods are 
applicable when determining a block mode for obtaining higher encoding 
efficiency and those skilled in the art could have easily adopted various 
criteria for determining the encoding efficiency. 

[166] Also, in this embodiment, a value of a SAD function is used as 

a criterion for determining the amount of data obtained, but one of other types 
of functions such as a SATD function, a SSD function, a MAD function, or a 
Lagrange function, may be used. 

[167] If it is determined in step 414 that all SAD function values, of 

even one of the four 8><8 sub blocks 2?/, B 2 , B3, and B4, which are stored in 4x4 
block units are not similar, step 416 is performed. 

[168] More specifically, the block mode determination unit 159 

receives from the motion estimator 157 the four SAD function values, of the 
respective four sub blocks 2?/, B2, B 3i and B 4i which are stored in 4x4 block 
units, and determines on an 8x8 block basis whether all four SAD function 
values in 4x4 block units are similar (step 416). 

[169] When all four SAD function values in 4x4 block units are 
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similar, a block mode for motion estimation on the input macro block is 
determined as the 8*8 block mode without taking further steps (step 418). 
[170] However, when all four SAD function values, of the sub block 

2?/, in 4x4 block units are not similar, the block mode determination unit 159 
outputs the control signal to the block divider 155, and the block divider 155 
divides the sub block Bj into four 4x4 sub blocks £/, b 2 , 63, and b 4 so as to 
perform motion estimation on a 4x4 block basis, in response to the control 
signal (step 710). 

[171] Next, the motion estimator 157 receives the four 4x4 sub 

blocks Z>y, Z>2, and b 4 of the sub block Bj from the block divider 155, 
performs motion estimation on these blocks, and determines their motion 
vectors MV(bj), MV(b 2 ), MV(b 3 ), and MV(b 4 ) (step 712). 

[172] Next, a block mode is determined depending on similarity 

among the motion vectors MV(b/), MV(b 2 ), MV(b 3 ), and MV(b 4 ) (step 800). 
[173] FIG. 13 is a detailed flowchart illustrating step 800 of FIG. 9. 

Referring to FIG. 13, when all four motion vectors MV(bj), MV(b 2 ), MV(bs)^ 
and MV(b 4 ) are similar, the block mode is determined as the 8x8 block mode 
(step 816). 

[174] However, if the motion vectors MV(bl) and MV(b2) are similar 

and the motion vectors MV(b3) and MV(b4) are similar, the block mode is 
determined as the 8x4 block mode (step 822). If the motion vectors MV(bl) 
and MV(b3) are similar and the motion vectors MV(b2) and MV(b4) are similar, 
the block mode is determined as the 4x8 block mode (step 832). 
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[175] However, there are cases where no adjacent blocks whose 

motion vectors are similar are present, or where a pair of adjacent first sub 
blocks are not similar although motion vectors of the other pair of adjacent 
first sub blocks are similar. In these cases, the block mode is determined as 
the 4x4 block mode (steps 818, 824, 828, and 834). 

[176] Next, the amount of data obtained in the block mode, 

determined with respect to the sub block B } in step 800, is compared with that 
of data obtained in the 4><4 block mode, determined with respect to the sub 
block Bj in steps 710 and 712, and then, the block mode in which less amount 
of data is obtained is selected as a final block mode of the sub block Bj (step 
900). 

[177] FIG. 14 is a detailed flowchart illustrating step 900 of FIG. 9. 

Referring to FIG. 14, the block mode determined with respect to the sub block 
Bi in step 800 is checked (step 910). 

[178] If the determined block mode is the 8x8 block mode, a cost 

cost(4*4) for the sub block Bj in the 4x4 block mode is calculated (step 912). 
The cost cost(4*4) is calculated by combining the four SAD function values 
obtained by motion estimation on the sub blocks bu b2, b$^ and Z>^of the sub 
block Bi in step 712. 

[179] After step 912, a cost cost (8*8) for the sub block Bj in the 8x8 

block mode is computed (step 914). The cost cost(8*8) is obtained using the 
SAD function value calculated to obtain the motion vector of the sub block Bj 
in step 412. 
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[180] Next, the block mode determination unit 159 receives the costs 

cost(8*8) and cost(4*4) from the motion estimator 157 and compares them 
(step 916). 

[181] If the cost cost(8*8) is smaller than the cost cost (4 *4), a block 

mode for motion estimation on the sub block B/ is finally determined as the 
8x8 block mode (step 918). 

[182] However, if the cost cost(4*4) is smaller than the cost 

cost(8*8), a block mode for motion estimation on the sub block Bi is finally 
determined as the 4x4 block mode (step 920). 

[183] When the block mode determined in step 910 is the 4x4 block 

mode, a block mode for motion estimation on the sub block Bj is finally 
determined as the 4x4 block mode without performing any additional 
processes (step 920). 

[184] When the block mode determined in step 910 is the 4x8 block 

mode, a cost cost(4x4) for the sub block Bj in the 4x4 block mode is 
calculated similarly to step 912 (step 922). 

[185] After step 922, the block mode determination unit 159 outputs 

the control signal to the block divider 155, and the block divider 155 divides 
the sub block B/ into two 4x8 sub blocks and provides them to the motion 
estimator 157 in response to the control signal. Then, the motion estimator 
157 performs motion estimation on the received two 4x8 sub blocks on a 4x8 
block basis using a predetermined reference picture(step 924). 
[186] The motion estimator 157 calculates a cost cost(4*8) for the 
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sub block B/ (step 926). The cost cost(4*8) for the sub block Bj is obtained 
by combining costs cost(4*8) calculated by motion estimation on the two 4x8 
sub blocks. 

[187] Next, the block mode determination unit 159 receives the costs 

cost (4* 4) and cost (4*8) from the motion estimator 157 and compares them 
(step 928). 

[1 88] If the cost cost(4 *8) is smaller than the cost cost(4 *4), a block 

mode for motion estimation on the sub block Bj is finally determined as the 
4x8 block mode (step 930). 

[189] However, if the cost cost(4*4) is smaller than the cost 

cost(4*8), a block mode for motion estimation on the sub block Bj is finally 
determined as the 4x4 block mode (step 920). 

[190] If the block mode determined in step 910 is the 8x4 block mode, 

a cost cost(4*4) for the sub block Bj in the 4x4 block mode is calculated 
similarly to step 912 (step 932). 

[191] Next, the block mode determination unit 159 outputs the 

control signal to the block divider 155, and the block divider 155 divides the 
sub block Bj into two 8x4 sub blocks and provides them to the motion 
estimator 157 in response to the control signal. The motion estimator 157 
performs motion estimation on the received two 8x4 sub blocks on an 8x4 
block basis using a predetermined reference picture (step 934). 
[192] The motion estimator 157 calculates a cost cost (8x4) for the 

sub block Bj (step 936). In this case, the cost cost(8*4) for the sub block Bj is 
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obtained by combining the costs cost (8*4) calculated by motion estimation on 
the respective two 8x4 sub blocks. 

[193] Next, the block mode determination unit 159 receives the costs 

cost(4*4) and cost(8*4) from the motion estimator 157 and compares them 
(step 938). 

[194] If the cost cost(8*4) is smaller than the cost cost(8*4), a block 

mode for motion estimation on the sub block Bj is finally determined as the 
8x4 block mode (step 940). 

[195] However, when the cost cost(4*4) is smaller than cost 

cost(8*4), a block mode for motion estimation on the sub block Bj is finally 
determined as the 4x4 block mode (step 920). 

[196] The present invention can be embodied as a computer readable 

code in a computer readable medium. Here, the computer readable medium 
may be any recording apparatus capable of storing data that is read by a 
computer system, e.g., a read-only memory (ROM), a random access memory 
(RAM), a compact disc (CD)-ROM, a magnetic tape, a floppy disk, an optical 
data storage device, and so on. Also, the computer readable medium may be a 
carrier wave that transmits data via the Internet, for example. The computer 
readable recording medium can be distributed among computer systems that 
are interconnected through a network, and the present invention may be stored 
and implemented as a computer readable code in the distributed system. 
[197] As described above, when motion estimation is conventionally 

performed in various block modes using a plurality of reference pictures, 
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motion estimation must be repeatedly performed on an input macro block with 
respect to the respective reference pictures and in the respective block modes. 
Next, a reference picture and a block mode, which lead to the highest 
encoding efficiency, are determined. Then, inter prediction coding is 
performed on the input macro block using the determined reference picture in 
the determined block mode. Accordingly, the above conventional method 
requires very large amount of calculation, thus weighing down an encoder. 
[198] To solve this problem, use of a method and apparatus for 

determining a reference picture for high-speed motion estimation, according to 
the present invention, remarkably reduces a number of times of performing 
motion estimation by using the result of motion estimation performed in one 
block mode. Accordingly, a reference picture and a block mode, or a block 
mode (when determination of a reference picture is not required) can be 
determined with less calculation. 

[199] While this invention has been particularly shown and described 

with reference to exemplary embodiments thereof, it will be understood by 
those skilled in the art that various changes in form and details may be made 
therein without departing from the spirit and scope of the invention as defined 
by the appended claims. 



39 



